134

11

Randomness and Complexity

conserved (and have a nonuniform probability distribution), whereas the noncoding

bits are fugitive (and have a uniform probability distribution). The information about

ee contained in the ensembleupper SS of copies is then the Shannon indexupper I left parenthesis upper S right parenthesis minus upper I left parenthesis upper S vertical bar e right parenthesisI(S)I(S|e). In

finite ensembles, the quantity

I (S|e) = −

Σ

s

p(s|e) log p(s|e)

(11.35)

can be estimated by sampling the distribution p left parenthesis s vertical bar e right parenthesisp(s|e).

Computational complexity reflects how the number of elementary operations

required to compute a number increases with the size of that number. Hence, the

computational complexity of “011011011011011011 ellipsis011011011011011011 . . .” is of order unity, since

one merely has to specify the number of repetitions.

Algorithmic and computational complexity are combined in the concept of logical

depth, 14 defined as the number of elementary operations (machine cycles) required

to calculate a string from the shortest possible program. Hence, the numberpiπ, whose

specification requires only a short program, has considerable logical depth because

that program has to execute many operations to yield piπ.

Problem. A deep notion is generally held to be more meaningful than a shallow one.

Could one, then, identify complexity with meaning? Discuss the use of the ways of

quantifying complexity, especially effective complexity, as a measure of meaning

(cf. Sect. 6.3.2).

A very simple measure of complexity, subsuming many variables, is to compare

the specific price of a manufactured object with its scrap value. Thus, a Eurofighter

Typhoon aircraft, which costs about 124 MUSD and weighs 11 t, has a specific price

of 11,272 USD/kg; assuming that it could be sold for (aluminium) scrap at a price of

0.84 USD/kg, the complexity ratio is 13,420. In contrast, a gold bar costing about 58

kUSD/kg would be sold for “scrap” at the same price, hence yielding a complexity

ratio of 1. The latest TSMC 3 nm wafer costs 20 kUSD; with a diameter of 300

mm and a thickness of about 0.775 mm it weighs 127.6 g, if made solely of silicon.

The specific price is, therefore, 156,740 USD/kg. Its scrap value is negligible but

let us suppose it equals the price of sand, typically costing 0.05 USD/kg; hence the

complexity ratio is about 3,134,800.

In contrast, a similar calculation applied to living organisms yields far lower com-

plexity ratios. For example, a racehorse weighing about 500 kg might cost 20 kUSD,

yielding a specific price of 400 USD/kg. This relatively low value presumably reflects

the simplicity of generating replicas—in contrast to the intricate manufacturing pro-

cesses required for aircraft and semiconductors, in which precision complexity has

to be explicitly engineered; from an embryo, in itself a highly complex object, much

greater complexity, especially when viewed at the nanoscale, spontaneously devel-

ops without explicit human intervention. The “scrap” value of the horse could be

taken as that of the carcass sold for its meat, priced at about 4 USD/kg. Hence, the

14 Due to Bennett (1988).